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SYSTEM INCLUDING A DIGITAL CAMERA AND A DOCKING 
UNIT FOR COUPLING TO THE INTERNET 
CROSS REFERENCE TO RELATED APPLICATIONS 

Reference is made to commonly assigned U.S. Patent Application 
5 Serial No. 09/620,890, filed July 21, 2000 and U.S. Patent Application Serial No. 
09/620,889; filed July 21, 2000 by M. Krishna Bandaru et al., the disclosures of 
which are incorporated herein by reference. 

FIELD OF THE INVENTION 
The present invention relates to digital cameras which include a 
10 viewable display and, more particularly, to a system that uses such a digital 
camera to receive and display information from the Internet. 

BACKGROUND OF THE INVENTION 
Current digital cameras can connect to a host computer via a dock 
in order to transfer images to the PC, and in some cases to download pictures and 
15 other types of files, such as MPS audio files, etc. from the PC to the camera. One 
example is the Kodak EasyShare DX3500 digital camera, which is sold with an 
optional docking unit. In this case, pictures can be downloaded from the PC to the 
camera, and the camera can later be used to view the images on the camera's 
LCD image display in "slideshow" mode. 
20 Current digital picture frame display devices, such as the Kodak 

Smart Picture Frame sold by Eastman Kodak Company, Rochester, NY, can 
connect to the Intemet via a phone line. They allow images to be viewed, 
uploaded for printing, and downloaded for viewing via a display slideshow mode. 
They also allow web pages with the weather, stock reports, etc. to be viewed. 
25 However, such devices cannot be used to capture images, and cannot be used in a 
portable mode, since they are not battery operated. 

The transfer of digital images from a user to a service provider is 
becoming more popular and more important. Typically, a digital camera user 
captures a group of digital images that are stored on a removable memory card. 
30 These images can be transferred from the memory card and stored, for example, 
on a hard drive or other non-volatile memory associated with the user's computer. 
While these images can be printed on a local printer, such as an Inkjet printer, it is 
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often simpler and less expensive for the user to have the images printed by a 
service provider. There are nimierous services that can be provided using digital 
images, such as storing the images on-line, printing the images, or producing 
digital storage media (e.g. CD-R discs) with duplicate copies of the digital images. 
5 These services can be provided at a remote location, typically a location in a 

different city, by the service provider. When services are ordered from a service 
provider, the images need to be uploaded using a channel such as the Internet. 

Digital images, from digital cameras or scanned photographic film, 
can be uploaded to a web site for viewing, as described in commonly assigned 

10 U.S. Patent 5,666,215 to Fredlund et al. Using a web browser, a group of these 
digital images can be viewed and selected for printing, for example using the 
Kodak Photonet Service. The user can select the size of each print to be 
produced, and the quantity of prints to be made from each image. 

Some web sites, such as the site provided by OFOTO at 

1 5 www.ofoto.com , enable a user to upload a group of digital images for sharing with 
others over the Intemet, and for providing digital printing services. This site 
permits a user to obtain an account using his e-mail address as the account name, 
and to provide a password and address information. The user can then upload a 
group of images. After all the images are uploaded, the user can select particular 

20 images for printing or sharing with third parties designated by the user. The user 
can return to this site at a later date, enter their e-mail address and password, and 
upload or print additional images. 

A problem with the prior art is that capturing, upIoading,^d 
conveniently viewing digital images via the Intemet requires that three expensive 

25 devices be used, a digital camera for capturing images, a desktop computer for 

uploading the images to a website for sharing, and a picture frame for viewing the 
images in a convenient location, such as on a nightstand or living room table. 
Purchasing and using these three devices is expensive and difficult. 

SUMMARY OF THE INVENTION 

30 It is an object of the present invention to facilitate a user being able 

to use a digital camera for directly communicating with a service provider. 
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It is another object of the present invention to permit the user of a 
digital camera with a display to make use of that display after communication has 
been established between the digital camera and a service provider, in order to 
receive and display images captured by others. 
5 It is another object of the present invention to provide a digital 

camera having a large color image display that is used with a docking unit to 
provide an attractive looking digital picture frame. 

Another object of this invention is to provide a low cost, easy-to- 
use system for capturing digital image, sharing the digital images with others, 
10 receiving digital images from others, and displaying these received digital images 
and other useful information conveniently. 

These objects are achieved by a system including a digital camera 
and a docking unit to permit the digital camera to be coupled to a channel, 
comprising: 

15 a) the digital camera including: 

i) a viewable display; 

ii) an image capture lens; 

iii) an image sensor for receiving a visual image 
provided by the capture lens to produce an image signal, a processor responsive 

20 to the image signal for producing a digital image so that the viewable display can 
respond to such image to provide a viewable image; and 

iv) a docking interface to permit the digital camera to 
be connected to the docking unit; and 

b) the docking unit including: 
25 i) means for receiving the docking interface in the 

digital camera and for connecting the digital camera to the docking unit; 

ii) means for providing power to the digital camera; 

and 

iii) means for interconnecting the docking unit to the 

30 channel; and 
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c) the processor providing communication through the 
docking unit so that it receives digital images via the channel and causes such 
digital images to be displayed on the viewable display. 

These objects are also achieved by a method for connecting a 
5 digital camera to a channel such as the Intemet, comprising the steps of: 

a) providing a digital camera having a viewable display and a 
docking unit for receiving the digital camera; and 

b) providing communication over the channel to the docking 
unit which directs image data to the docked digital camera that provides viewable 

10 images on the viewable display of such camera. 

ADVANTAGES 
It is an advantage of the present invention to use the same digital 
camera for capturing and displaying captured digital images, and for displaying 
images provided by others which have been stored by a service provider and 

1 5 communicated by the service provider over a channel such as the Intemet. 

It is a further advantage of the present invention to provide a 
system having a digital camera and a docking xmit, to permit the direct connection 
of the digital camera to the service provider in a cost effective manner, eliminating 
the need for an intermediate device such as a personal computer. 

20 It is another advantage of the present invention to provide a system 

having a digital camera and a docking unit which allows the display on the digital 
camera to be viewable, thus providing an attractive way to store the digital camera 
when it is not capturing images, and to ensure that the camera batteries are 
recharged. 

25 BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 depicts a block diagram of a system that implements this 

invention; 

FIG. 2 is a flow diagram showing the process of capturing images, 
communicating with a service provider, and displaying images on a viewable 
30 display of the digital camera; 

FIG. 3 is a block diagram of the digital camera that can be a part of 
the system of this invention; 





-5- 

FIG. 4 is a block diagram of the docking unit that can be a part of 
the system of this invention; 

FIG. 5A is a front view of the digital camera and the docking unit 
when they are disconnected; 
5 FIG. 5B is a rear view of the digital camera docked in the docking 



image display (e.g. a color LCD, Organic Light Emitting Display [OLED] or the 
20 like). The camera operates as a normal digital camera to capture images. It also 
connects to a docking unit, which provides power and network connectivity, for 
example via a phone line. The camera is inserted into the dock with the lens 
facing away from the user and the viewable display facing towards the user. The 
docking unit is typically located in the master bedroom, kitchen, etc., rather than 
25 next to a computer in the office or den. The combination of the camera and 
docking unit form a system that both transfers the captured digital images to a 
service provider via the Intemet, and displays images and other information 
downloaded from a service provider on the large viewable camera display, thus 
providing the capabilities of a digital picture frame. 
30 When the camera is connected to the docking unit, the system can 

automatically upload any newly captured images to a network service provider for 
storage and/or printing. This can be done using the methods described in 



15 



10 




DETAILED DESCRIPTION OF THE INVENTION 



In this invention, the digital camera includes a large viewable 
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commonly assigned U.S. Patent Application Serial No. 09/569,079, filed May 11, 
2000 by Parulski et al., the disclosure of which is herein incorporated by 
reference. 

After the images are uploaded, the system then begins to 
5 automatically receive and store various types of information, in accordance with 
selections made by the user when they purchased or configured their system. 
Examples of this information include digital still or motion images, such as 
favorite photographs or video snippets stored on the network, either by the user or 
by a third party which authorizes the user to access this information, and presented 

10 in a slideshow type format. The system also stores and displays information 
provided by Intemet web sites, such as the local weather, headline news, stock 
prices, sport scores, etc, which is of interest to the user. The various information 
can be displayed on the viewable display either by automatically cycling though 
the information, or in response to user menu selections. 

15 Once disconnected from the dock, the content downloaded from 

the Intemet (e.g. local weather, etc.) can still be viewed on the camera viewable 
display, so that the user can more easily read the information, or read the 
information in a different room, or while on-the-go. When the user selects the 
camera capture mode, the information ceases to be presented on the camera 

20 display, and the camera functions as a digital image capture device. 

FIG. 1 depicts a block diagrani of a system that implements the 
present invention. As shown in FIG.. 1, the system includes a digital camera 300 
which includes a docking interface 322 to facilitate connection with a docking unit 
350. The docking unit 350 includes a modem 370 (shown in FIG. 4) for 

25 establishing a connection with a network service provider 30, such as an Intemet 
service provider (ISP), to provide a network connection to a channel 36, such as 
the Intemet. The system further includes a content service provider 40, which 
communicates with camera 300 via the ISP 30. The content service provider 40 
receives and stores digital image files uploaded from the digital camera 300, and 

30 stores and downloads digital image files and other information to the camera 300. 
The content service provider 40 includes an Intemet server 42 for communicating 
with the Intemet (e.g. channel 36). The content service provider 40 also includes 
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an electronic database 44, which is located remote from the digital camera 300, 
for storing digital images and other information. The content service provider 40 
also includes a billing system 46, which provides bill issuing 48. 

The various portions of the content service provider 40 can be 
5 located in a single building or complex of adjacent buildings, or can be 

geographically dispersed over several sites in different cities or even different 
continents. For example, the Internet server 42, the electronic database 44, and 
billing system 46 can be provided by computers located in different cities and 
interconnected via a suitable digital communications network, such as the Intemet. 

10 Furthermore, the electronic database 44 can itself be distributed over several 
computers in several different locations. 

The system also includes a home computer system 10 which can be 
used to order and configure the services and information provided by the content 
provider 40, such as the information (e.g. current stock prices for companies of 

15 interest to the user) that is automatically downloaded from the content provider 40 
to the digital camera 300. Altematively, the user can order and configure the 
services and information via a retail outlet, via a telephone call to a representative 
of the service provider, via a mail-in order form, or the like. 

The home computer 10 includes a CPU motherboard 12, having for 

20 example, an Intel Pentiimi processor as well as RAM memory. The CPU 

motherboard 12 executes software stored on a hard drive 20, for example, the well 
known Windows ME operating system software and the Intemet Explorer web 
browser software, both provided by Microsoft Corp. of Redmond, WA. The CPU 
motherboard 12 is coupled to a display monitor 14 and a keyboard 16. A 

25 mouse 18 permits the user to readily communicate with the CPU motherboard 12. 
The home computer 10 also includes a dial-in modem 22 for commxmicating with 
the ISP 30 in order to connect to a channel 36, such as the Intemet. The CPU 
motherboard 12 communicates with a card reader 24, which can read and write 
data on a removable flash memory card 330 (shown in FIG. 3) used in the digital 

30 camera 300. 

The ISP 30, for example, Earthlink Network, Inc. of Pasadena, CA, 
includes banks of modems 32, one of which is connected to commimicate with the 
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modem 370 in the docking unit 350, or the modem 22 of the customer's 
computer 10. The modem 32 in turn communicates with computers/routers 34 in 
order to provide a connection to the channel 36 using equipment and techniques 
well known to those skilled in the art. 
5 The content service provider 40 communicates with a fulfillment 

system 50, which is comprised of one or more computers and associated 
peripherals for producing photo products, such as hardcopy prints, album pages, 
photo mugs, PictureCD discs, and the like. The fulfillment system 50 includes a 
computer that serves as a production controller 52, and controls one or more color 

10 printers 54, which can produce photo products 66 such as album pages or standard 
hardcopy prints. The hardcopy prints can be of various sizes, and can be sold in 
frames. The production controller 52 is also connected to a CD writer 76, which 
can produce PictureCDs having digital images and application software for using 
the digital images. The production controller 52 can optionally be connected to 

15 devices (not shown) for producing other types of photo products 66 such as 

t-shirts, coffee mugs, etc. incorporating one or more images uploaded by the user. 
The production controller 52 also controls a shipping system 70 which controls a 
shipping label printer 72 to produce a shipping label 74. The shipping label 74 is 
attached to a shipping container (e.g. a cardboard box containing packing 

20 material) that contains and protects the photo product 66 during shipment (e.g. 
via air express mail, ground carrier, etc.) to the user or the user's designee. 

In addition to receiving and storing digital images produced by 
digital cameras, the content service provider can scan photographic film using 
appropriate equipment (not shown), or receive digital images produced by 

25 scanning film by a different service provider, to produce digital images that can be 
stored in the electronic database 44, as described in commonly assigned U.S. 
Patent 5,666,215 to Fredlxmd et al., the disclosure of which is incorporated herein 
by refereince. 

The electronic database 44 provides information describing 
30 numerous photo products that can be provided by the fulfillment system 50, as 
described in commonly assigned U.S. Patent Application Serial No. 09/576,288, 
filed May 23, 2000 by Parulski et al., the disclosure of which is incorporated 
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herein by reference. This includes information describing photo product options, 
for example, album features such as providing various backgroxmd colors or 
textures, page numbers, page captions, image captions, etc. The albvun pages can 
be bound in a cover, or can include holes to permit the pages to be inserted into a 
5 standard binder, such as a three-ring binder. These album feature options can be 
demonstrated via software programs, for example, JAVA applets, MPEG or 
QuickTime movies, or Shockwave files, which depict the functionality of features 
that the customer can choose. 

The electronic database 44 includes information describing each 

10 customer account, including user billing information, a user profile for providing 
information content to the user, and user image storage information. The billing 
information can include a payment identifier for the user, such as a charge card 
number, expiration date, and user billing address. The user profile indicates the 
types of information that the user wants to receive fi*om the Intemet when their 

15 digital camera 300 is mated with the docking imit 350. The user image storage 
information includes a list of images uploaded by the user and stored in the 
electronic database 44. The electronic database 44 also provides long-term 
storage of the uploaded images for each user. In this embodiment, stored images 
are accessible (e.g. viewable) via the Intemet by authorized users, as described, 

20 for example, in commonly assigned U.S. Patent 5,760,917 to Sheridan, the 
disclosure of which is herein incorporated by reference. The electronic 
database 44 can be contained on the same computer as the network server 42, or 
can utilize a separate computer, or can be distributed over several computers at the 
same physical site, or at different sites. 

25 On a regular basis (e.g. monthly) or altematively whenever a photo 

product 66 is purchased by the user, the electronic database 44 communicates with 
a billing system 46 to verify that the payment identifier (e.g. credit card or debit 
card number) provided by the customer is vaUd, and to debit the account for the 
purchase or the monthly service fee for providing information to the user and 

30 storing user images. As shown in block 48, the bill is issued. The customer's 

account that is debited can, of course, be located at a remote financial institution. 
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FIG. 3 is a block diagram showing the digital camera 300 in more 
detail. Electrical power for all of the circuits of the digital camera 300 is provided 
by rechargeable batteries 346 via power supply 344. The rechargeable batteries 
346 are recharged via power supplied by the docking unit 350 to the docking 
5 interface 322. The digital camera 300 produces digital images that are stored on 
the removable memory card 330. The digital camera 300 includes a zoom 
lens 312 having zoom and focus motor drives 310 and an adjustable aperture and 
shutter (not shown). The zoom lens 312 focuses light from a scene (not shown) to 
provide an optical image focused on an image sensor 314, for example, a single- 

10 chip color CCD image sensor, using the well known Bayer color filter pattern. 
The image sensor 314 is controlled by clock drivers 306. The zoom and focus 
motors 310 and the clock drivers 306 are controlled by control signals supplied by 
a control processor and timing generator circuit 304. The control processor and 
timing generator 304 receives inputs from autofocus and autoexposure 

15 detectors 308 and controls a flash 302. The analog image signal from the image 
sensor 314 is amplified and converted to digital data by the analog signal 
processing (ASP) and analog-to-digital (A/D) converter circuit 316. The digital 
image data from the A/D converter 3 1 6 is stored in a DRAM buffer memory 318 
and subsequently processed by a processor 320 controlled by the firmware stored 

20 in the firmware memory 328, which can be flash EPROM memory. 

The processed digital image file is provided to a memory card 
interface 324, which stores the digital image file on the removable memory 
card 330. Removable memory cards 330 are known to those skilled in the art. 
For example, the removable memory card 330 can conform to the Compact Flash 

25 interface standard, such as is described in the CompactFlash Specification Version 
1.3, published by the CompactFlash Association, Palo Alto, California, August 5, 
1998. Other types of removable memory cards, including Smart Media cards, PC 
cards, SD cards, or Memory Stick cards, and other types of digital memory 
devices, such as magnetic hard drives, magnetic tape, or optical disks, could 

30 altematively be used to store the digital images. 

The processor 320 performs color interpolation followed by color 
and tone correction, in order to produce rendered sRGB image data. The rendered 
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sRGB image data is then JPEG compressed and stored as a JPEG image file on 
the removable memory card 330, The processor 320 also creates a smaller size 
digital image which can be created as described in conmionly assigned U.S. Patent 
5,164,831 to Kuchta et al., the disclosure of which is herein incorporated by 
5 reference. This smaller size image is stored in RAM memory 326 and supplied to 
the color image display 332, which displays the smaller sized, processed digital 
image for the user to review. The color image display 332 provides a viewable 
display, and can use an LCD display, an OLED display, or other types of display 
technologies. 

10 The digital camera 300 is controlled by user controls 303, some of 

which are shown in more detail in FIG. 5, The user controls 303 include a shutter 
release (e.g. a capture button) 380, which initiates a picture taking operation, 
up/down buttons 382, left/right buttons 384, and select button 386. The graphical 
user interface displayed on the color LCD image display 332 is controlled by the 

15 user interface portion of the firmware stored in the firmware memory 328. The 
camera user interface also includes microphone 333 which coimects to an audio 
amplifier and A/D converter 335, to provide a digital audio signal to the processor 
320. The camera user interface can also include a digital-to-analog (D/A) 
converter and audio amplifier 337, and a miniature speaker 339, which plays back 

20 the recorded audio, and also makes audible sounds when a new picture is taken, or 
when the user changes modes or advances to review the next stored image. The 
digital camera 300 can also include a video output driver and connector (not 
shown) for displaying the captured images on a TV (not shown). 

The JPEG file stored on the removable memory card 330 uses the 

25 so-called "Exif ' image format defined in "Digital Still Camera Image File Format 
(Exif)" version 2.1, July 1998 by the Japan Electronics Industries Development 
Association (JEIDA), Tokyo, Japan. This format includes an Exif application 
segment that stores particular image metadata, for example the date and time the 
picture was captured, the lens fi'mmiber and other camera settings, and image 

30 captions or comments that can be selected or entered by the camera user. 

The Exif image files, containing the JPEG compressed main image, 
thimibnail image, and the image metadata, are stored on the removable memory 
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card 330 using a directory structure conforming to the so-called "DCF" rules 
defined in "Design Rule For Camera File System" version 1.0, December 1998 by 
the Japan Electronics Industries Development Association (JEIDA), Tokyo, 
Japan. An example directory stmcture recorded on DOS formatted removable 
5 memory card 330 by the camera 300 is depicted in FIG. 6. Three directories are 
recorded under the root directory 400, MISC directory 410 containing a file 412 
named AUTPRINT.MRK, DCIM directory 420 which contains subdirectories 430 
and 440, and a CONTENT directory 450. File 412 is a Digital Printer Order 
Format (DPOF) file, which specifies images to be printed, as will be described 

10 later. Subdirectory 430 is narned 100_DCAM, to conform to the DCF rules, and 
contains four JPEG compressed Exif image files, PIC_0001.JPG 432, 
PIC__0002.JPG 434, PIC_0003.JPG 436, and PIC_0004.JPG 438. Files 432, 434, 
436, which have been captured by the digital camera 300. 

Subdirectory 440 is named 101_XFER to conform to the DCF 

15 rules. The purpose of subdirectory 440 is to provide a known location for the 

digital camera 300 to store image files on removable memory card 330 which are 
downloaded fi"om the content service provider 40 when the digital camera is 
connected to the docking unit 350. The files stored in subdirectory 440 include 
three JPEG compressed image files, file 442 named IMG_0001.JPG, file 444 

20 named IMG_0002.JPG, and file 446 named IMG_0003.JPG. There JPEG files 

have been previously downloaded fi*om the content service provider 40 and can be 
displayed on the color LCD image display 332, as will be described later in 
reference to FIG. 2. Instead of JPEG image files, other types of image file 
formats, including TIFF, GIF, JPEG2000, and the like, could be used. The size of 

25 the image files stored in subdirectory 440 can be significantly lower resolution 
(e.g. can have fewer lines and fewer pixels per line) than the images captured by 
the digital camera, since they are only used to provide a displayable image but are 
not used to provide prints. As a result, a large nxmiber of downloaded images can 
be stored on the removable memory card 330. Because the fiiU resolution images 

30 are retained by the content service provider, high quality reprints of these images 
can be obtained by transferring the fiiU resolution image data stored at the content 
service provider 40 to the fiilfillment service 50 to produce photo products 66. 
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Subdirectory 450 is named CONTENT, and provides a known 
location for image processor 320 to store content information (e.g. stock quotes, 
weather reports, and the Uke), downloaded from the content service provider 40 
when the digital camera is connected to the docking imit 350. Subdirectory 450 
5 contains a number of files, one for each type of information that is downloaded 
from the content service provider according to the selections made by the user 
when the user's service account was estabUshed. The files include file 452 named 
WEATHER.TXT, file 454 named STOCKS.TXT, file 456 named SPORTS.TXT, 
file 458 named NEWS.TXT, and file 460 named JOKES.TXT. Instead of using 

10 text (TXT) files, the files could use other document formats, or could be HTML 
web pages, or graphic or raster image files. 

The graphical user interface displayed on the color LCD image 
display 332 is controlled by user controls 303. The digital camera 300 can also 
include a video output driver and connector (not shown) for displaying the 

15 captured images on a TV (not shoAvn). The user uses the user controls 303 to set 
the camera in the "capture" mode prior to capturing images. The user sets the 
camera in the "review" mode in order to review the captured images (e.g. image 
files 432, 434, 436 and 438 in FIG. 6.) The user can then review the image files 
and delete imdesirable images the user controls 303. 

20 The user can also use the user controls 303 to set the camera in a 

"place order" mode. In this mode the user can select images for printing, and can 
specify how many copies to make. The camera creates an image utilization file, 
as described in commonly assigned U.S. Serial No. 09/004,046 filed January 7, 
1998 to Ward et. al., the disclosure of which is herein incorporated by reference. 

25 This image utilization file 412, named AUTPRINT.MRK, is an ASCII text file 
containing these instructions, and is known as a Digital Print Order Format 
(DPOF) file. 

The user can also review the downloaded image files stored in 
subdirectory 440. Using user controls 303, the user reviews the image files, (e.g. 
30 files 442, 444, 446 in FIG. 6) and can selects one or more images that they would 
like to reprint. This might typically occur as the user receives images shared by 
firiends on the color LCD image display 332. To order reprints, the user selects. 
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using user controls 303, selects which images to print, how many copies to make, 
etc. The Digital Print Order Format (DPOF) file 412 is then updated to include 
his print order, and to indicate via the image pathname, that the images to be 
printed are already stored at the content service provider 40. 
5 After a series of images have been taken and stored on the 

removable memory card 330, the camera 300 is connected to the docking imit 
350. The docking interface 322 in the digital camera 300 includes an electrical 
connector that mates with a complimentary connector in the docking unit. The 
removable memory card 330 can also be inserted into a memory card reader 24 in 

10 the user's host computer 10 shown in FIG. 1, so that the images can be displayed, 
stored, modified, incorporated in documents, etc. 

FIG. 4 is a block diagram of the docking unit 350 that forms part of 
the preferred embodiment of the system of this invention. The docking unit 350 
includes a connector 352 which mates with the docking interface 322 of the digital 

15 camera 300. The docking unit 350 supports the digital camera, as shown in 

FIG. 5B, so that the color LCD image display 332 of the digital camera 300 can be 
viewed. In a preferred embodiment, the docking unit 350 includes some type of 
power supply, such as a power converter 360 which receives power from the AC 
plug 362, for recharging the rechargeable batteries 346 of the digital camera 300, 

20 which is supplied to the digital camera 300 via connector pins 354 of connector 
352. The docking unit also includes a telephone modem 370 which connects to a 
telephone wall jack (not shown) via a standard phone cable 374 connected to the 
phone connector 372, and which also connects to the digital camera via connector 
pins 356 of connector 352. The modem provides a network connection for 

25 interconnecting the docking unit to a channel, such as the Intemet. Many other 
types of network connections are possible, including wireless connections, higher 
speed network connections such as cable modem connections, and the hke. 
Connector 352 also includes a connector pin 358, which is connected to a fixed 
potential (e.g. a +Vcc potential) when the camera 300 is connected to the docking 

30 unit 350. In alternative embodiments, the modem 370 could be included in the 
digital camera 300, or the docking unit 350 could include a low cost 
microprocessor. 
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The firmware memory 328 of the digital c^era 300 includes one 
or more phone nimibers for accessing the content service provider. The alternate 
or back-up phone numbers are provided in the event that the first number called is 
busy or becomes inaccessible. When the camera is connected to the docking unit 
5 350, the presence of the +Vcc potential on pin 358 is detected. The image 
processor 320 then dials an appropriate number to access the content service 
provider 40. 

FIG. 5 A is a firont view of the digital camera and the docking unit 
when they are disconnected. As described earlier in reference to FIG. 3, the 

10 digital camera 300 includes a zoom lens 312 and a flash 302 used when capturing 
digital images, and a removable memory card 330 which stores the captured 
digital images. As described earlier in reference to FIG. 4, the docking unit 350 
includes a connector 352 which mates with the docking interface 322 of the digital 
camera 300. The docking unit 350 includes an AC plug 362 for supplying power, 

15 and a phone connector 372 which connects to a telephone wall jack (not shown) 
via a standard phone cable 374. 

FIG. 5B is a rear view of the digital camera 300 docked in the 
docking xmit 350. As described earlier in relation to FIG. 3, the camera includes a 
color image display 332 and a number of user controls 303. The user controls 303 

20 include a shutter release 380, up/down buttons 382, left/right buttons 384, and 

. select button 386. The camera also includes a microphone 333 and a speaker 339. 
These provide a user interface that will be described in detail in reference to 
FIG. 8A-C. 

Turning now to FIG. 2, there is shown a flow diagram showing the 
25 process of capturing images, commxmicating with a service provider, and 

displaying images on a viewable display of the digital camera. As shown in 
block 100, the customer begins the configuration process. This can be done by the 
customer, using their home computer 10, or alternatively at a retail establishment, 
when the digital camera 300 and docking unit 350 are purchased or leased. In 
30 either case, this can be done (by the user or retail clerk) using an Intemet 
connection to the content service provider 40, to initiate the process of 
establishing an account for the user with the content service provider 40, and 
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providing customer account information which is then stored in the electronic 
database 44. 

In block 102, the customer (possibly with the cissistance of the 
retail clerk) enters their name, selects a password, and provides delivery and 
5 billing information. This information identifies the customer and one or more 

customer's designees (e.g. the person to whom various photo products 66 might in 
the future be shipped, which can of course be the customer). It includes addresses 
of both the customer and one or more of the customer's designees. The customer 
also identifies an account to be debited to pay for the monthly service fees, as well 

10 as for any photo product(s) to be purchased. Often this will be a credit card 
having a payment identifier that specifies the account of the customer to be 
charged or debited. Frequently, this will be in a financial institution. The 
payment identifier can be a credit card number that specifies a particular credit 
card account. As used in this specification, a credit card will also include a debit 

15 card. 

In block 104, the customer selects the type of content that they 
would like the content service provider 40 to provide when the digital camera 300 
is connected to the docking unit 350. This content information can include stock 
quotes for particular companies of interest to the customer. It can also include the 

20 weather report for one or more regions of interest to the customer. It can also 

include the names of sports teams of interest to the customer. It can also include 
the types of news (e.g. national politics, religion, entertainment, etc.) of interest to 
the customer. It can also include one or more hobbies or types of entertainment of 
interest to the customer. 

25 In block 106, the customer selects, from a menu of photo product 

and service options that are available, one or more particular photo products 
and/or service to be provided by the content service provider 40, and/or the 
fiilfillment system 50 when the images to be captured by the customer's digital 
camera 300 are uploaded to the content service provider 40. As described earlier 

30 in reference to FIG. 1, the photo product options are described U.S. Patent 
Application Serial No. 09/576,288, filed May 23, 2000 by Parulski et al., the 
disclosure of which is incorporated herein by reference, and include standard 
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service prints in various sizes (e.g. 3" x 5" prints, 4" x 6" prints, etc.) and various 
surface finishes (e.g. glossy, matte finish, etc.), as well as customized photo 
albums. The standard prints can also include text, such as the date the picture was 
captured or printed. The options can also include storing the digital images in a 
5 user account in the electronic database 44, or providing containing the images 
using CD writer 76. 



The information stored in the service account includes the information provided 
by the customer in blocks 102-106. This includes the content options selected in 
10 block 104 and the photo product options selected in block 106. The service 

account information is preferably stored as part of the electronic database 44 of 



The cj^tomer namje, password, customer e-mail address, customer shipping 
15 address, and billingViformation provided by the customer in block 102 is included 
in the service account information (lines 3-7). The billing information (e.g. credit 
card number) and other sensitive information provided in the service account can 
be encrypted to prevent discovery and unauthorized use. 



20 information can also include (Pmes 9-15) a list of the content of interest to the 

customer, provided by the customer in block 104. This includes a designation of 
how often the content information>should be updated (line 10), which can be 
daily, twice daily, hourly, anytime tfte content changes, etc. It also includes a list 
of the various topics of interest to the customer (e.g. weather, stocks, sports) 

25 selected in block 104. The service account information can include weather 
categories (line 11) with the cities or otherVegions of interest to the customer. 
The service account information can also include a financial categories, such as a 
stock price category (line 12) providing a list of particular stocks (e.g. EK for 
Eastman Kodak, INT for Intel Corporation, WM^ for WalMart Corp.) of interest 

30 to the customer. The service account information Van also include a sports 

category (line 13), providing a list of sports teams oV interest to the customer (e.g. 
Milwaukee Brewers, Milwaukee Bucks, Green Bay Packers). The service accoimt 



In block 108, a service account is established for the customer. 




;G. 7 provides an example of the service account information. 



As shown in me example depicted in FIG. 7, the service account 




.18- 



information can also i 



ill 



elude a news category (line 14), providing a list of new 



topics (e.g. Rochester, 
interest to the customei 



NY local news, U.S. national political news) of particular 
The service account information can also include a joke 



category (line 15), providing a list of humorous topics (e.g. family humor, 
5 political humor, sports humor) of interest to the customer. 

As sho\ m in FIG. 7, the service account information can also 
include information de scribing one or more photo product options selected by the 
customer in block 106 These can include identifiers (ID) such as Product ID-1 
(lines 21-30) which spi cifies a customized album. Product ID-2 (lines 32-35) 

10 which specifies a Pictu eCD disc, and Product ID-3 (lines 37-42) which specifies 
customized service prir ts. The album related information (lines 21-30) includes 
the page size, album tyj le, and background style selected. It also includes page 
number information, su :h as the style, font, and color of the text. The album 
related information alsc indicates that designee #1 (e.g. the customer) should 

15 receive the order (line 3jp). 

The PictureCD information (lines 32-35) specifies that a new CD 
should be created each time 100 images have been uploaded to the content service 
provider 40 (line 34). It also indicates that designee #1 (e.g. the customer) should 
receive the order (line 35). 

20 The service print information (lines 37-42) specifies the print size, 

print finish, and the location, font style, size, and color of the date to be overlaid in 
the print. The information also indicates that designee #2 should receive the prints 
(line 42) and the order status (line 42). 

The upload time information (lines 44-45) indicates the customer 

25 selected upload time. At line 46, it indicates an upload time of 1 :00 am eastern 
standard time (EST). The upload time information could altematively indicate 
"immediately". 

In block 110, the customer captures a group of digital images using 
the digital camera 300, as described earlier in reference to FIG. 3. The customer 
30 also creates the Digital Print Order File 412 specifying what images are to be 
printed, and how many copies of each print to produce, and the Uke. 
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In block 112, the customer connects the digital camera, including 
the removable flash memory card 330, to the docking unit 350. 

In block 1 14, the group of images captured by the digital camera 
are uploaded to the service provider along with the DPOF file 412. The upload 
5 time can be selected by the user in block 106. In some cases, this is immediately 
after the user places the digital ceimera 300 in the docking unit 350. In other 
cases, the images are transferred at a specified time, typically at night when the 
user's computer and phone line are unlikely to be needed. In the event that the 
consumer needs the phone line while the image uploading is being conducted, the 
10 uploading will terminate. This can be noted by the digital camera 300 or the 

Intemet server 42, which can automatically re-establish the connection at a later 
time, via the network service provider 30, and upload the images which have not 
y£tJ)eentransferred. 

block 1 14, as the group of digital images is uploaded from the 
15 digital camera 300^o the content service provider 40, the service account 

information in FIG. ^s updated to include a list of the uploaded images. The 
image list (lines 48-66) p^rovides a list of image identifiers corresponding to the 
uploaded images. The upl^d list provides a reference number (e.g. Image 1), and 
the image name (e.g. PIC_OO^.JPG) used when the image was stored on the 
20 digital camera 300. 

In block 116, the high resolution digital image files are deleted 
from removable flash memory card 330 of the digital camera 300, since these files 
are now stored at the service provider. In some embodiments, display resolution 
versions of these files are maintained in a separate directory, so that they can be 
25 displayed on the color LCD image display 332 in "slide show" mode, and so that 
addition prints or other photo products can be ordered fi-om the digital camera 300 
and fulfilled using the high resolution file which is stored by the content service 
provider 40. This can be done as described in commonly assigned U.S. Patent 
Application Serial No. 09/718,018, filed November 20, 2000 by Endsley et al., the 
30 disclosure of which is herein incorporated by reference. 

A^^^^>^ block 118, the services and photo products selected by the user 
are pr<Jvided by ffie content service provider 40 and/or the fulfilhnent system 50. 



3r<Jvided by me conte 

\ 



15 



20 



25 



30 
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5s/the c 



The production controller 52 produces /the customized photo products using the 
uploaded images and the service account information stored in electronic database 
44. If the user has ordered an album, the uploaded digital images can be 
automatically arranged on the pages ^ id printed by color hardcopy printer 54 to 

in commonly assigned U.S. Patent 
ed July 2, 1999 by Loui et al.; U.S. Patent 
Application Serial No. 09/199,724, filed November 25, 1998 by Shaffer et al; and 
Serial No. 09/199,639, filed Novembdr 25, 1998 by Shaffer et al., the disclosures 
of which are herein incorporated by re ference. If the user has ordered one or more 



produce album pages 56 as described 
Application Serial No. 09/347,310, fi 



10 PictureCDs using the uploaded image; >, the CDs are produced using CD writer 76. 



In block 106, the user can select to ha^ 



^e a CD produced only after a certain 



number of images (e.g. 100 images) h ive been uploaded to the content service 
provider 40, as described earlier in re^ ^rence to FIG. 7. 

In block 118, the production controller 52 in FIG. 1 also controls 
the shipping label printer 72 to produce the shipping label 74 using the shipping 
address of the customer or customer's designee provided in the service account 
information. The shipping label 74 is attached to the shipping container 64 that is 
used to ship the photo product 66. Also, the customer account provided in the 
service accoimt information is billed for the order. 

In block 120, content is transferred from the content service 
provider 40 to the digital camera 300. These files are stored in the content 
directory 450 described earlier in relation to FIG. 6. If content files with the same 
names are already stored in the content directory 450, the file creation date of the 
stored file is examined. If the date and time of the files are the same, the file does 
not need to be downloaded. However, if the date and time of the file currently 
stored in content directory 450 is older than the file to be provided by the content 
service provider 40, the newer file is downloaded to the digital camera 300 and 
stored on the removable flash memory card 330, overwriting the older file. This 
enables the latest weather, sports, information to be available to the customer. 

In block 122, digital image files are transferred from the content 
service provider 40 to the digital camera 300. These files are stored in 101_XFER 
directory 440 as described earlier in relation to FIG. 6. 




-21- 



In block 124, the customer views the downloaded content, 
downloaded digital image files, and captured display resolution images on the 
color image display 332 of the digital camera 300. 

FIG. 8 A depicts a user interface screen 5 00 A displayed on the 
5 color image display 332 when the digital camera 300 is reviewing captured 

images. The user interface can use the methods described in commonly assigned 
U.S. Patent 6,147,703 to Miller et al., and U.S. Patent 6,233,015 to Miller et aL, 
the disclosures of which are herein incorporated by reference. The user interface 
screen 500A includes an image display window 502 for displaying one or more of 
10 the digital images stored on the removable memory card 330. The user interface 
screen 500A includes three icons 506-508, which indicate the current display 
mode. Icon 506 is highlighted, indicating that the current display mode is to 
display images captured by the digital camera 300. In this mode, the digital 
camera 300 displays the captured images stored in the lOO DCAM directory 430 
- 1 5 shown in FIG. 6. 

In FIG. 8A, icon 507 can be selected in order to display digital 
image files transferred firom the content service provider 40 to the digital camera 
300 in block 122 of FIG. 2, as will be described in relation to FIG. 8B. Icon 508 
can be selected in order to display content transferred from the content service 
20 provider 40 to the digital camera 300 in block 120 of FIG. 2, as will be described 
in relation to FIG. 8C. 

In FIG. 8A, the camera user has the ability to navigate among the 
captured images through use of the left and right arrow buttons 384 in FIG. 5B. In 
addition, the user has the ability perform a number of actions using the digital 
25 images stored on the removable memory card 330 of the digital camera 300 by 
selecting appropriate icons. By selecting icon 510, the user can indicate the 
quantity and size of prints to be made using the currently viewed image, as 
described earlier in reference to DPOF file 412 in FIG. 6. By selecting icon 512, 
the user can annotate the image with a verbal description using the built-in 
30 microphone 333. The audio information is recorded into a separate file as 

described in the Exif 2.1 standard referenced earlier. By selecting icon 514, the 
user can change the method of viewing images in image display window 502 in 
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order to review multiple images simultaneously, or examine portions of the 
currently viewed image in enlarged detail. By selecting icon 516, the user can 
delete the image currently displayed in image display window 502. 

An information bar 504 displays information to the user concerning 
5 the feature provided by the icon (e.g. icons 510-516), as it is selected by the user. 
For example, as the user begins to select icon 512 to record audio information, the 
information bar 504 displays the information shown in 504A, which indicates that 
this feature enables the user to "record voice annotation for this image". 

When the user selects one of the icons 510-512, the user interface 
10 screen 500 is updated to provide a new user interface screen corresponding to the 
selected icon. For example, the user interface screen 500B is displayed when 
voice annotation icon 512 is selected. The user interface screen 500B includes 
audio control icons 517 which enable the user to record and playback the voice 
annotation. 

15 When the user selects icon 507 in FIG. 8 A, (or automatically when 

the digital camera 300 is placed in the docking unit 350, if this is the default mode 
previously selected by the user), the user interface screen displayed on color 
image display 332 is user interface screen 500C shown in FIG. 8B. In this mode, 
the digital camera 300 displays the images transferred from the service provider, 

20 which have previously been stored in the 101_XFER directory 440 shown in 

FIG. 6. Icon 507 is highlighted, indicating that it is the current display mode. The 
user can change modes by selecting icons 506 or 508. 

In FIG. 8B, the camera user has the ability to navigate among the 
downloaded images through use of the left and right arrow buttons 384 in 

25 FIG. 5B. In addition, the user has the ability perform a number of actions by 

selecting appropriate icons. An information bar 504 displays information 504B to 
the user conceming the downloaded images. By selecting icon 516, the user can 
delete the image currently displayed in image display window 502. By selecting 
icon 510, the user can indicate the quantity and size of prints to be made using the 

30 currently viewed image. This information is transferred to the content service 

provider 40 (FIG. 2), which makes the appropriate prints from the high resolution 
images stored in the electronic database 44 using the fulfillment system 50. 
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By selecting icon 518, the user can initiate a slide show 



presentation of the images transferred from the content service provider 40. The 
images are displayed, one at a time, on the color image display 332 of the digital 
camera 300, by displaying the single image on the user interface screen 500D in 
5 FIG. 8B. The display time for each image, and the particular images displayed, 
can use default values (e.g. 10 seconds, all images), or can be manually selected 
by the user. The default values can also be reprogrammed by the user. For 
example, the user can select a default value so that when the digital camera 300 is 
placed in the docking unit 350, the images transferred from the content service 
10 provider 40 in block 120 of FIG. 2 are automatically displayed, one at a time, 
using the user interface screen 500D for a set period of time (e.g. 30 seconds 
each), until the user presses one of the user controls 303. 



the digital camera 300 is placed in the docking unit 350, if this is the default mode 
15 selected by the user), the user interface screen displayed on color image display 
332 is user interface screen 500E shown in FIG. 8C. In this mode, the digital 
camera 300 displays the content files transferred from the service provider, which 
have previously been stored in the CONTENT directory 450 shown in FIG. 6. 
Icon 508 is highlighted, indicating that it is the current display mode. The user 
20 can change modes by selecting icons 506 or 507. 



the various categories selected by the user in block 104 of FIG. 2. Content display 
window 520 displays the information from the sports content file. This content 
may be text information only, or may include graphics, still digital images, or 

25 video images 522 as well as text messages 524. The text messages can include 
final scores, statistics, and the like. The user can select other content categories 
by selecting appropriate icons, such as the weather icon 530, stocks icon 532, 
sports icon 534, or news icon 536 shown in content category icon area 528, 
through use of the left and right arrow buttons 384 in FIG. 5B. 

30 In addition, the user has the ability perform a nxunber of actions by 

selecting appropriate icons. By selecting icon 516, the user can delete the content 
file currently displayed in content display window 520. By selecting icon 518, the 



When the user selects icon 508 in FIG. SB (or automatically when 



In FIG. 8C, the camera user has the ability to review the content for 
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user can initiate a slide show presentation of the content transferred from the 
content service provider 40. The content files are displayed, one at a time, on the 
color image display 332 of the digital camera 300. The display time for each file 
can use default values (e.g. 20 seconds per file). 
5 ^^/]^ block 130, the digital camera 300 communicates with the 

content3ervice jM^pvider 40 in order to download updated content, such as the 
latest stock reports^sports scores, etc. This can be done on a regular basis (e.g. 
twice per day) or on\an as-needed basis, as the content changes, depending on the 
content update option\elected by the customer, as described earlier in relation to 

10 line 10 of FIG. 7. 

In block 132 the customer disconnects the camera from the docking 
unit. In this case, the customer can still use the color image display 332 to view 
the digital images and content that have been previously downloaded, while the 
camera batteries 346 power the camera. This provides a convenient way for the 

1 5 customer to view the downloaded content. 

The customer can, of course, repeat blocks 1 10 to 1 12 to capture 
another group of digital images and transfer the images to the content.service 
provider 40, which can then provide additional photo products and services as 
described in relation to blocks 114-118. 

20 A computer program product, such as a readable storage mediimi, 

can store the programs in accordance with the present invention for operating the 
methods set forth above. The readable storage medium can be a magnetic storage 
media, such as a magnetic disk (such as a floppy disk) or magnetic tape; optical 
storage media, such as an optical disk, an optical tape, or a machine readable bar 

25 code; solid state electronic storage devices, such as a random access memory 

(RAM) or a read only memory (ROM); or any other physical device or medium 
employed to store computer programs. 

The invention has been described in detail with particular reference 
to certain preferred embodiments thereof, but it will be understood that variations 

30 and modifications can be effected within the spirit and scope of the invention. 
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PARTS LIST 



10 


home computer 


12 


CPU motherboard 


14 


display monitor 


16 


keyboard 


18 


mouse 


20 


hard drive 


22 


modem 


24 


card reader 


30 


Internet service provider 


32 


modems 


34 


computers/routers 


36 


channel 


40 


content service provider 


42 


Internet server 


44 


electronic database 


46 


billing system 


48 


bill issuing 


50 


fulfillment system 


52 


oroduction controller 


54 


color nrinter 


66 


ohoto nroduct 


70 


'^hinninff svstem 


72 


shipping label printer 


74 


shipping label 


76 


CD writer 


100 


block 


102 


block 


104 


block . 


106 


block 
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PARTS LIST (con't) 



108 


block 


110 


block 


112 


block 


114 


block 


116 


block 


118 


block 


120 


block 


122 


block 


124 


block 


130 


block 


132 


block 


300 


digital camera 


302 


flash 


303 


user controls 


304 


control processor and timing generator circuit 


306 


clock driver 


308 


autofocus and autoexposure detectors 


310 


zoom and focus motor drives 


312 


zoom lens 


314 


image sensor 


316 


analog signal processing and analog-to-digital converter circuit 


318 


DRAM buffer memory 






322 


docking interface 


324 


memory card interface 


326 


RAM memory 


328 


firmware memory 


330 


flash memory card 


332 


image display 



PARTS LIST (con't) 



333 


microphone 


335 


audio amp & A/D 


337 


D/A and audio amp 


339 


speaker 


344 


power supply 


346 


rechargeable batteries 


350 


docking unit 


352 


connector 


354 


connector pins 


356 


connector pins 


358 


connector pin 


360 


power converter 


362 


AC plug 


370 


modem 


372 


phone connector 


374 


phone cable 


380 


shutter button 


382 


up/down arrows 


384 


left/right arrows 


386 


select button 


400 


root directory 


410 


MISC directory 


412 


digital pnnt order file 


420 


DCIM directory 


430 


subdirectory 


432 


file 


434 


file 


436 


file 


438 


file 
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PARTS LIST (con't) 



440 


subdirectory 


442 


file 


444 


file 


446 


file 


450 


CONTENT directory 


452 


file 


454 


file 


456 


file 


458 


file 


460 


file 


500A 


user interface screen 


500B 


user interface screen 


500C 


user interface screen 

vt^-^^rX XXX VX^X ^dft'Ki/X^ w^/xx^^^xx 


500D 


user interface screen 

VfrhJli^X XXX^V/X X.«pl>%a<^^ W«^X ^^Ib^XX 


500E 


user interface screen 

VfrfcJ XXXV^^X hJX^X^^^/XX 


502 


ima^e disnlav window 

XXXXUr^^%/ XX-Xh^Lif Xft««i y TT xxxvxv 


504 


information bar 


5 04 A 


information 


504B 


information 

XXXX.V^X XXXCXLXV^XX 


506 


icon 


507 


icon 


508 


icon 


D 1 u 


icon 


512 


icon 


514 


icon 


516 


delete icon 


517 


audio control icons 


518 


slide show icon 


520 


content display window 
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PARTS LIST (con't) 



522 video images 

524 text messages 

528 content category icon area 

530 weather icon 

532 stocks icon 

534 sports icon 

536 news icon 



